Discriminant Analysis When the Initial Samples are Contaminated
نویسنده
چکیده
This paper investigates one aspect of the robustness of Fisher's linear discriminant function-robustness against contamination in the initial samples. Asymptotic results are derived for normal location contamination and for normal scale contamination with the contaminating covariance matrix a multiple of the uncontaminated population covariance matrix. It is shown that when the prior probabilities of the two underlying populations are equal, scale contamination of the initial samples has no effect on our ability to make correct classifications. When the prior probabilities of the two populations are unequal, scale contamination can have a harmful effect. Location contamination can be even more harmful than scale contamination. Small sample results are presented for the case of scale contamination with equal prior probabilities. Finding that for small samples, Fisher's LDF may perform very poorly when the initial samples are scale contaminated, three types of "robust discriminant functions" are proposed as alternatives to Fisher's LDF. The three types of dis-criminant functions are evaluated for various combinations of parameters (sample size, distance between the underlying populations, amount of contamination, type of contamination). It is found that for mild contamination , Fisher's LDF performs as well as the "robust procedures." For more severe contamination, a Type I LDF, formed from Fisher's LDF by replacing Xl' x 2 ' and S by robust estimates of location and scale, improves our ability to discriminate. Adviser Reader Reader ACKNOWLEDGMENTS The author wishes to express her appreciation for the assistance of her advisor, Dr. P. A. Lachenbruch, who suggested the problem and who provided gUidance throughout the research. In addition, she would like to thank the other members of her committee, Dr. helpful criticisms and suggestions. She also wishes to thank her husband, Yahia, for his encouragement throughout her studies and her daughter, Wendy, who was born in the middle of the writing of this dissertation, for her patience during the first six months of her life. Finally, she wishes to express her thanks to Mrs. Gay Hinnant for her excellent typing of this manuscript.
منابع مشابه
Feature reduction of hyperspectral images: Discriminant analysis and the first principal component
When the number of training samples is limited, feature reduction plays an important role in classification of hyperspectral images. In this paper, we propose a supervised feature extraction method based on discriminant analysis (DA) which uses the first principal component (PC1) to weight the scatter matrices. The proposed method, called DA-PC1, copes with the small sample size problem and has...
متن کاملMorphological differences among the Cyprinion macrostomus (Cyprinidae) populations in the Tigris River
In this study, by examining the character of the morphometric and meristic in which Cyprinion macrostomus samples obtained from different locality in Tigris, morphometric character which are transformed subject to discriminant analysis and depending on grouping model to number of discriminant functions and according to importance of these totally variance, morphogical variance among populations...
متن کاملIntrusion Detection in IOT based Networks Using Double Discriminant Analysis
Intrusion detection is one of the main challenges in wireless systems especially in Internet of things (IOT) based networks. There are various attack types such as probe, denial of service, remote to local and user to root. In addition to known attacks and malicious behaviors, there are various unknown attacks that some of them have similar behavior with respect to each other or mimic the norma...
متن کاملSupervised Feature Extraction of Face Images for Improvement of Recognition Accuracy
Dimensionality reduction methods transform or select a low dimensional feature space to efficiently represent the original high dimensional feature space of data. Feature reduction techniques are an important step in many pattern recognition problems in different fields especially in analyzing of high dimensional data. Hyperspectral images are acquired by remote sensors and human face images ar...
متن کاملAn exometabolomics approach to monitoring microbial contamination in microalgal fermentation processes by using metabolic footprint analysis.
The early detection of microbial contamination is crucial to avoid process failure and costly delays in fermentation industries. However, traditional detection methods such as plate counting and microscopy are labor-intensive, insensitive, and time-consuming. Modern techniques that can detect microbial contamination rapidly and cost-effectively are therefore sought. In the present study, we pro...
متن کامل